Information processing apparatus, information processing system, information processing method, program, and recording medium

ABSTRACT

The present invention provides an information processing apparatus capable of selecting a region of cancer cells in any tissue sample image and easily and accurately counting the number of the cancer cells. The information processing apparatus is an information processing apparatus  100  including: an acquisition unit  110  for acquiring image data obtained by reading a tissue sample image  150  obtained by putting a mark  151  specifying a selected area  152  on an image obtained by immunostaining and then imaging a biological tissue; and a counting unit  120  for counting the number of cancer cells in the selected area  152  specified by the mark  151  based on the image data of the tissue sample image  150  acquired by the acquisition unit  110,  wherein a diagnosis based on the tissue sample image  150  is supported.

TECHNICAL FIELD

The present invention relates to an information processing apparatus, aninformation processing system, an information processing method, aprogram, and a recording medium.

BACKGROUND ART

In diagnosis based on a tissue sample image of a biological tissue, aregion of cancer cells is selected, and the number of the cancer cellsis counted. For example, in the patent document 1, information on atumor region is acquired based on a HE-stained image, and thisinformation is aligned with an IHC-stained image, and thus, a tumorregion in the IHC-stained image is specified.

PRIOR ART DOCUMENT

-   Patent Document

Patent Document 1: WO 2008/108059

SUMMARY OF INVENTION Problem to be Solved by the Invention

However, it has been really difficult to specify a tumor region in anIHC-stained image, specifically in an image in which cell membranes arebarely stained, i.e., the staining is classified as “0”. Therefore, itis required that a region of cancer cells in any tissue sample image canbe accurately selected, and the number of the cancer cells can beaccurately counted.

Hence, the present invention is intended to provide an informationprocessing apparatus, an information processing system, an informationprocessing method, a program, and a recording medium, capable ofselecting a region of cancer cells in any tissue sample image and easilyand accurately counting the number of the cancer cells.

Means for Solving Problem

In order to achieve the aforementioned object, the informationprocessing apparatus according to the present invention is aninformation processing apparatus including: an acquisition unit foracquiring image data obtained by reading a tissue sample image obtainedby putting a mark specifying a selected area on an image obtained byimmunostaining and then imaging a biological tissue; and a counting unitfor counting the number of cancer cells in the selected area specifiedby the mark based on the image data of the tissue sample image acquiredby the acquisition unit, wherein a diagnosis based on the tissue sampleimage is supported.

The information processing system according to the present invention isan information processing system including: the information processingapparatus according to the present invention; an input terminal; and adisplay terminal, wherein the information processing apparatus includes:a receiving unit for receiving the image data via a network; and asending unit for sending, via a network, the number of cancer cellscounted in the selected area specified by the mark by the counting unit,and the image data received by the receiving unit is input and sent viaa network by the input terminal, and the number of cancer cells countedin the selected area specified by the mark by the counting unit isreceived via a network and displayed by the display terminal.

The information processing method according to the present invention isan information processing method using the information processingapparatus according to the present invention, the method including: anacquiring step of acquiring, by the acquisition unit, image dataobtained by reading a tissue sample image with a mark specifying aselected area; and a counting step of counting, by the counting unit,the number of cancer cells in the selected area specified by the markbased on the image data of the tissue sample image acquired by theacquiring step.

The program according to the present invention is a program capable ofexecuting the information processing method according to the presentinvention on a computer.

The recording medium according to the present invention is acomputer-readable recording medium including: the program according tothe present invention.

Effects of the Invention

According to the present invention, a region of cancer cells in anytissue sample image can be selected, and the number of the cancer cellscan be counted easily and accurately.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a block diagram showing a configuration of an informationprocessing apparatus according to the first embodiment of the presentinvention.

FIG. 2 is a block diagram showing a configuration of an informationprocessing system according to the second embodiment of the presentinvention.

FIG. 3 is a sequence diagram showing a processing sequence in theinformation processing system according to the second embodiment of thepresent invention.

FIG. 4A is a block diagram showing a hardware configuration of apathological image diagnosis support apparatus according to the secondembodiment of the present invention.

FIG. 4B is a block diagram showing a configuration of a RAM in thepathological image diagnosis support apparatus according to the secondembodiment of the present invention.

FIG. 4C is a block diagram showing a configuration of a storage in thepathological image diagnosis support apparatus according to the secondembodiment of the present invention.

FIG. 5 is a flowchart showing a procedure for operating the pathologicalimage diagnosis support apparatus according to the second embodiment ofthe present invention.

FIG. 6 is a figure showing the first example of a tissue sample imagewith a mark according to the second embodiment of the present invention.

FIG. 7 is a figure showing the second example of a tissue sample imagewith marks according to the second embodiment of the present invention.

FIG. 8 is a figure showing an image for checking a selected areaaccording to the second embodiment of the present invention.

FIG. 9 is a figure showing the first example of a send image accordingto the second embodiment of the present invention.

FIG. 10 is a figure showing the second example of a send image accordingto the second embodiment of the present invention.

FIG. 11 is a figure showing the third example of a tissue sample imagewith marks according to the second embodiment of the present invention.

FIG. 12 is a sequence diagram showing a processing sequence in aninformation processing system according to the third embodiment of thepresent invention.

FIG. 13 is a figure showing a selected area divided into meshes in thethird embodiment of the present invention.

FIG. 14 is a sequence diagram showing a processing sequence in aninformation processing system according to the fourth embodiment of thepresent invention.

FIG. 15 is a figure showing superimposition of a selected area accordingto the fourth embodiment of the present invention.

DESCRIPTION OF EMBODIMENTS

Embodiments of the present invention are illustrated in detail belowwith reference to figures. Components described in the followingembodiments, however, are mere examples, and the technical scope of thepresent invention is not limited only thereby.

First Embodiment

An information processing apparatus 100 according to the firstembodiment of the present invention is described with reference toFIG. 1. FIG. 1 shows the information processing apparatus 100 whichsupports a diagnosis based on a tissue sample image 150 obtained byimmunostaining and then imaging a biological tissue. The informationprocessing apparatus 100 includes: an acquisition section (acquisitionunit) 110 for acquiring image data 155 obtained by reading the tissuesample image 150 with a mark 151 put thereon and specifying a selectedarea 152. The information processing apparatus 100 further includes: acounting section (counting unit) 120 for counting the number of cancercells in the selected area specified by the mark 151 based on the imagedata 155 of the tissue sample image 150 acquired by the acquisitionsection 110. With the above-described configuration, a region of cancercells in any tissue sample image can be easily and accurately selected,and the number of the cancer cells can be easily and accurately counted.It is to be noted that the “selected area” is also referred to as a“focus area” in the present invention.

Second Embodiment Configuration of Information Processing SystemIncluding Pathological Image Diagnosis Support Apparatus as InformationProcessing Apparatus According to the Second Embodiment

FIG. 2 is a block diagram showing a configuration of an informationprocessing system 250 including a pathological image diagnosis supportapparatus 200 as the information processing apparatus according to thesecond embodiment. In FIG. 2, the pathological image diagnosis supportapparatus 200 is connected, via a network 240, to a plurality of clientPCs 220 each of which includes a color scanner 221 for reading(inputting) a tissue sample image thereinto. The pathological imagediagnosis support apparatus 200 is also connected to a pathologicalimage diagnosis center 230 for sending an image or results obtainedthrough processes by the pathological image diagnosis support apparatus200 so that specialized physicians can analyze and diagnose. Thepathological image diagnosis support apparatus 200 corresponds to theinformation processing apparatus according to the present invention. Itcan be said that each of the client PCs 220 and the color scanners 221corresponds to an “input terminal” of the information processing systemaccording to the present invention. It can be said that each of theclient PCs 220 also corresponds to a “display terminal” of theinformation processing system according to the present invention. It canbe said that the pathological image diagnosis center 230 alsocorresponds to a “display terminal” of the information processing systemaccording to the present invention. The network 240 may be a publicnetwork including the Internet or an in-hospital LAN.

The communication control section 201 of the pathological imagediagnosis support apparatus 200 receives a tissue sample image with amark sent from a client PC 220 via a network (i.e., image data obtainedby reading the tissue sample image with a mark by a color scanner 221).That is, it can be said that the communication control section 201corresponds to a “receiving unit” for receiving, via a network 240, thetissue sample image with a mark. The received tissue sample image with amark (image data) is stored in an image storage section (image storageunit) 202. It can be said that the image storage section (image storageunit) 202 corresponds to an “acquisition unit” for acquiring image dataobtained by reading the tissue sample image with a mark. In a markrecognition section (mark recognition unit) 203, a mark on the tissuesample image with the mark is recognized together with the positionthereof. In a mark position storage section (mark position storage unit)204, the position of the recognized mark is stored. This storage allowssuperimposing a tissue sample image in the fourth embodiment describedbelow. In a mark-specified region selection section (a selection unit ora mark-specified region selection unit) 205, a mark-specified region isselected based on the tissue sample image with the mark and the positionof the mark stored in the image storage section 202. In the presentembodiment, the inside of the mark which is a closed curve is aspecified region. The present invention, however, is not limitedthereto, and a region including the position of the mark may beautomatically set as a mark-specified region. A mark is not limited toonly one, and there may be a plurality of marks. In a specified regiondividing section (a dividing unit or a specified region dividing unit)206, a mark-specified region of the third embodiment described below isdivided into meshes, and the divided regions are transmitted to a cancercell counter (counting unit) 207.

The cancer cell counter 207 counts the number of cancer cells with eachstaining intensity in a parenchymal cell region to be observed in themark. In a display data generation section (display data generationunit) 208, send data is generated based on a count value obtained bycounting the number of cancer cells with each staining intensity by thecancer cell counter 207,the tissue sample image, or the mark. Desireddisplay data in a diagnosable format is selected as the display data bythe client PC 220. The selected display data is sent from thecommunication control section 201 to the client PC 220 via the networkand is displayed on a display screen. Alternatively, the selecteddisplay data is sent to the pathological image diagnosis center 230 sothat specialized physicians can analyze and diagnose. That is, it can besaid that the communication control section 201 also corresponds to a“sending unit” for sending, via a network 240, a count value obtained bycounting the number of cancer cells in the selected area specified bythe mark of the tissue sample image by the counting unit.

Processing Sequence in Information Processing System According to theSecond Embodiment

A processing sequence in the information processing system according tothe second embodiment is shown below with reference to FIG. 3.

In a sequence S301, a color scanner 221 reads a slide with a mark whichis a tissue sample image with a mark. In a sequence S303, the readtissue sample image with a mark is then sent from the color scanner 221to a client PC 220 and is sent to a pathological image diagnosis supportapparatus 200 which is the information processing apparatus. That is, itcan be said that a series of the sequences S301 and S303 corresponds toan “inputting and sending step” of, by the input terminal, inputting(reading) and sending, via a network, image data received by a receivingunit (communication control section 201). In a sequence S305, thepathological image diagnosis support apparatus 200 receives the imagedata from a communication control section 201 (receiving step), thenacquires the image data in an image storage section (acquisition unit)202 (acquiring step), and recognizes the mark in the mark recognitionsection 203. The mark is a mark put on the slide of the tissue sampleimage by a physician with a magic marker in order to separate a focusarea of stained positive cells (an area in which the number of cancercells is counted) from the other area, for example.

In sequences S307 to S313 indicated by a dotted line in FIG. 3, a resultof the mark recognition is displayed on the client PC 220, and theselected area in the mark is checked. These sequences, however, areperformed optionally. For example, when the mark is not closed as aclosed curve, it becomes necessary for a user to check an area in whichthe number of cancer cells is counted. A mark other than this may be apoint indicating the center position of the area or a line segmentindicating a part of the edge of the area. First, in the sequence S307,a screen for selecting an area (hereinafter referred to as an “areaselection screen”) (see FIG. 8 described below) is generated. In thesequence S309, the generated area selection screen is then sent from thepathological image diagnosis support apparatus 200 to the client PC 220.In the sequence S311, the area selection screen is displayed on theclient PC 220, and the area is checked. Subsequently, in the sequenceS313, an instruction of counting the number of cancer cells in the areaby a user is sent to the pathological image diagnosis support apparatus200.

In a sequence S315 (counting step), the pathological image diagnosissupport apparatus 200 counts the number of cancer cells in the selectedarea in the mark. If a checking sequence, i.e., a series of thesequences S307 to S313 indicated by a dotted line is not performed, thesequence is shifted from the sequence S305 to the sequence S315. In asequence S317 (sending step), the counted number of cancer cells issent. The sending of the counted number of cancer cells includes sendingof display data of the selected area.

(Variation of Processing Sequence)

A series of sequences S321 to S329 of FIG. 3 is a variation of theprocessing sequence. In the sequence S321, a slide with or without amark is read as a tissue sample image. In the sequence S323, a mark isadded on a display screen of the acquired tissue sample image by theclient PC 220 (see FIG. 7 described below). In the sequence S325, thetissue sample image with the added mark or the tissue sample image withthe mark which has been put thereon and the added mark is sent from theclient PC 220 to the pathological image diagnosis support apparatus 200.In the sequence S327, the pathological image diagnosis support apparatus200 counts the number of cancer cells in each selected area in the putmark and/or the added mark. In the sequence S329, the counted number ofcancer cells is sent. The sending of the counted number of cancer cellsincludes sending of display data of the selected area.

<Hardware Configuration of Pathological Image Diagnosis SupportApparatus>

FIG. 4A is a block diagram showing a hardware configuration of thepathological image diagnosis support apparatus 200 as an informationprocessing apparatus according to the second embodiment. As shown inFIG. 4A, the pathological image diagnosis support apparatus 200includes: a CPU (Central Processing Unit) 410; a ROM (Read Only Memory)420; a communication control section 201; a RAM (Random Access Memory)430; and a storage 440.

In FIG. 4A, the CPU 410 is an arithmetic and control processor andexecutes programs so that functions of sections of FIGS. 2 and 3 can beachieved. The ROM 420 stores fixed data such as initial data and initialprograms and programs. As described for FIG. 2, the communicationcontrol section 201 communicates, via the network 240, with client PCs220 and the pathological image diagnosis center 230 which are outsidedevices.

The RAM 430 is a temporal storage section used as a working area fortemporal storage by the CPU 410. Generally, image data to be processed431 and display data 432 are temporally stored in the RAM 430. The RAM430 includes a program execution region 433 for executing programs bythe CPU 410.

The storage 440 is a nonvolatile storage of diagnosis supportinformation 441, various parameters 442, and various programs 443.

As shown in FIG. 4B, the image data 431 to be processed in the RAM 430includes the following data.

-   a tissue sample image with a mark 451 received via the communication    control section 201-   a mark image 452 recognized from the tissue sample image with a mark    Storage of the mark image may be storage of an address of the    position of the mark image or a closed curve generated based on    thinning, smoothing, or the mark image.-   an image 453 of one selected area selected from the received tissue    sample image

The display data 432 sent to the client PC 220 via the communicationcontrol section 201 includes the following data.

-   a selected area-mapped image 461 obtained by mapping the selected    area into the received tissue sample image-   the first selected area image 462 of the first selected area-   the first cell count value 463 which is the counted number of cancer    cells with each staining intensity in the first selected area image    The same kind of data is included in display data 432 for each of    subsequent selected areas.

As shown in FIG. 4C, the diagnosis support information 441 in thestorage 440 includes the following data.

-   a received tissue sample image 471-   the position and size 472 of the selected area as a partial region    selected from the tissue sample image-   the count value 473 relating to cancer cells in the selected area-   processed display data 474 stored so as to be searchable by the    tissue sample image, the patient, the case, and the like

As shown in FIG. 4C, various parameters 442 in the storage 440 includethe following parameters.

-   a closed curve extraction parameter 481 for extracting the put mark    or the added mark on the tissue sample image    For example, when a color of each mark is previously set so as to be    distinguishable on a tissue sample image, the closed curve    extraction parameter 481 is used as a parameter indicating the    color. When the shape of each mark is previously set to circle,    rectangle, or the like so as to be distinguishable on a tissue    sample image, the closed curve extraction parameter 481 is used as a    parameter indicating the shape.-   a closed curve formation parameter 482 for distinguishing and    complementing a non-closed line so as to be a closed curve when the    mark put by a user is a simple circular non-closed curve

As shown in FIG. 4C, various programs 443 in the storage 440 include thefollowing programs.

-   a diagnosis support program 491 for supporting diagnosis-   a mark extraction program 492 for extracting a mark on a tissue    sample image and recognizing a selected area (for executing S520 of    FIG. 5)-   a cell count program 493 for counting the number of cells with each    staining intensity in the image of the selected area (for executing    S540 of FIG. 5)

Procedure for Operating Pathological Image Diagnosis Support Apparatus200 According to the Second Embodiment

A procedure for operating a pathological image diagnosis supportapparatus 200 having the above-described configuration is described indetail below with reference to flowcharts and examples of displayscreens. A CPU 410 executes programs shown in each flowchart so thatfunctions of the components in FIG. 2 are achieved.

(Procedure for Supporting Diagnosis)

FIG. 5 is a flowchart showing an overall procedure for supportingdiagnosis in the present embodiment.

In a step S500 (receiving step), the pathological image diagnosissupport apparatus 200 waits for a tissue sample image with a mark to besent from a client PC 220. When the tissue sample image with a mark isreceived, it is stored in a step S510 (acquiring step). FIG. 6 shows thefirst example of the tissue sample image with a mark, and FIG. 7 showsthe second example of the tissue sample image with marks. In the tissuesample image 600 with a mark of FIG. 6, a mark 601 which is a closedcurve enclosing a region 602 in which a user desires to count the numberof cancer cells is drawn in, for example, dark blue although it is notdistinguished in FIG. 6. In the tissue sample image 700 with marks ofFIG. 7, a rectangular mark 701 and marks 702 to 704 which are closedcurves, enclosing each region in which a user desires to count thenumber of cancer cells are drawn in the respective colors although it isnot distinguished in FIG. 7, for example. The difference between FIGS. 6and 7 is as follows. In FIG. 6, the mark is drawn on a slide by a userwith a magic marker or the like. In FIG. 7, the marks are overlaid onthe display screen of the client PC 220. The mark drawn on a slide andthe mark overlaid on the display screen may be present together.

In a step S520, a mark is extracted from the received tissue sampleimage with the mark, and a selected area is recognized. Various methodsare known as a method for extracting a mark or a method for recognizinga selected area, and any of them can be used.

A step S530 is a step of checking a selected area with a user,corresponding to a series of sequences S307 to S313. First, in a stepS531, an image is generated by mapping a selected area into the tissuesample image. In a step S533, the selected area-mapped image thusobtained is sent to the client PC 220. FIG. 8 shows an example of adisplay of the selected area-mapped image. In a selected area-mappedimage 800 of FIG. 8, a closed curve 801 extracted from a mark isdisplayed in pink, and a selected area 802 is filled in green. Thus, thedisplay is converted into a display easily checked by a user. Then, thepathological image diagnosis support apparatus 200 waits for a user tocheck and accept, and when it is instructed to count the number ofcancer cells, the step is shifted to a step S540.

In the step S540 (counting step), the number of the cancer cells witheach staining intensity in the selected area in the mark is counted. Inthe case of including a plurality of marks, the pathological imagediagnosis support apparatus 200 waits for all of selected areasindicated by the marks to be processed completely in a step S550. Whenall of the selected areas are processed completely, the step is shiftedto a step S560. In the step S560, display data of the counted number ofcancer cells is generated in order to send it to the client PC 220. FIG.9 shows the first example of a display screen displaying the countednumber. FIG. 10 shows the second example of a display screen displayingthe counted number. The display screen of FIG. 9 includes a tissuesample image 900 of the selected area and the counted number 901 witheach staining intensity. In the tissue sample image 900, cells with eachstaining intensity are colored a different color and then displayed, andthe description thereof, however, is omitted. A display screen 1000 ofFIG. 10 includes: an enlarged tissue sample image 1001 of one selectedarea; a reduced-size image 1002 of the selected area; and a thumbnailimage 1003 of the tissue sample image. The display screen 1000 furtherincludes: thumbnail images 1004 of five selected areas, each including abar-graph; and a bar-graph 1010 according to the selected area. Thebar-graph 1010 includes: a region 1011 indicating the number of cellswith “strong” staining intensity, a region 1012 indicating the number ofcells with “weak” staining intensity, and a region 1013 indicating thenumber of cells with “none” of staining intensity, for example. Thethumbnail image 1003 of the entire tissue sample image and the thumbnailimages 1004 of five selected area, each including a bar-graph aredisplayed as buttons. FIG. 10 shows the case where the third selectedarea indicated by the numeral “3” is selected. A dark box of the thirdselected area indicated by the numeral “3” among the thumbnail images ofthe five selected areas indicates the result that the third selectedarea is selected. In a step S507 (sending step), the generated displaydata is sent to the client PC 220.

(Example of Adding Selected Area)

In a step S580, whether or not a user added a selected area andinstructed to count the number of cells is determined from the resultdisplayed on the client PC 220. When it is determined that a user addeda selected area, the pathological image diagnosis support apparatus 200waits for a tissue sample image with a mark specifying the addedselected area to be sent in the step S500. When the tissue sample imageis received, the steps from S510 to S570 are performed. FIG. 11 shows atissue sample image with marks specifying added selected areas. In adisplay image 1100 of FIG. 11, marks 1106 of the added selected areasare superimposed on a tissue sample image 1101 in addition to marks 1105of selected areas in each of which the number of cells has been counted.Although not shown in FIG. 11, the marks 1105 are indicated by red, andthe marks 1106 are indicated by yellow, so that they aredistinguishable, for example. The numerals 1102 to 1104 indicatethumbnail images of selected areas in each of which the number of cellshas been counted as buttons for selection as indicated by the numerals1002 to 1004 of FIG. 10.

Third Embodiment

The third embodiment shows an example of dividing a selected area intomeshes and counting the number of cells in each small area of each meshwhen the large number of cancer cells is contained or masses of cancercells are spread in the selected area in a mark, for example.Alternatively, a selected area may be divided into meshes, the number ofcells in each mesh may be counted, and the total number of cells may beused as the counted number. In this case, even if a part of the selectedarea in a mark has a score of +3, wrong diagnosis might be made by usingthe average of scores as a determination result. Therefore, thefollowing is desired. Some meshes are automatically selected from themeshes into which a selected area is divided, and scores in the selectedmeshes are determined, or meshes are superimposed on a selected area,and a user is requested to select meshes for determining scores thereof.In the present embodiment, as shown in FIG. 4C, the storage 440 includesa mesh size parameter 483 as one of various parameter 442. The mesh sizeparameter 483 is used as a parameter for dividing a selected area intomeshes when the large number of cancer cells is contained or masses ofcancer cells are spread in the selected area in a mark, for example (seeFIG. 13). The storage 440 further includes a mesh division program 494as one of various programs 443. This program is used to divide aselected area into meshes and executes S1201 of FIG. 12.

Processing Sequence in Information Processing System According to theThird Embodiment

A processing sequence in the information processing system according tothe third embodiment is shown below with reference to FIG. 12.

In a sequence S301, a color scanner 221 reads a slide with a mark whichis a tissue sample image with a mark. In a sequence S303, the readtissue sample image with a mark is then sent from the color scanner 221to a client PC 220 and is sent to a pathological image diagnosis supportapparatus 200 which is an information processing apparatus. In asequence S305, the pathological image diagnosis support apparatus 200recognizes the mark. The above-described sequences are the same as thosein FIG. 3 of the second embodiment.

Subsequently, in a sequence S1201, the pathological image diagnosissupport apparatus 200 divides the selected area selected with the markinto meshes. The selected area is divided using the mesh size parameter483 shown in FIG. 4C. The mesh size is appropriately set according tothe size, the enlargement ratio, the resolution, the number of cells inone mesh, and the like, for example. FIG. 13 shows an example of adisplay obtained by dividing a selected area selected with a mark intomeshes. In a display image 1300 of FIG. 13, the selected area in a mark1301 is divided into 81 mesh regions 1302. In a sequence S1203, thenumber of cells in each mesh is counted, and the total counted number ofcells in the 81 mesh regions 1302 is calculated by the pathologicalimage diagnosis support apparatus 200. Then, in a sequence S1205, thetotal counted number of cancer cells is sent to the client PC 220 as aresult of the total counted number of cancer cells. It is desired thatthe send data includes display data of the selected area with meshessuperimposed thereon of FIG. 13.

In a sequence S1207, whether or not a user instructed to count thenumber of cells not in the entire selected area but in each of theselected meshes is determined from the selected area with meshessuperimposed thereon, displayed on the client PC 220. When noinstruction of selecting meshes (hereinafter referred to as a “selectioninstruction”) was made, a process is terminated. When a selectioninstruction was made, meshes specified according to the selectioninstruction are acquired in a sequence S1209. The client PC 220 sendsinformation (the mesh number or mesh position information) on the meshesselected in a sequence S1211 to the pathological image diagnosis supportapparatus 200. The pathological image diagnosis support apparatus 200counts the number of cells in each selected mesh in a sequence S1213 andsends the counted number of cancer cells in each selected mesh in asequence S1215 to the client PC 220.

Fourth Embodiment

In the fourth embodiment, a plurality of tissue sample images obtainedthrough staining by a plurality of staining methods shares a markextracted from one tissue sample image with the mark. In the presentembodiment, a mark extracted from a HE-stained slide with the mark isapplied to an IHC-stained slide without the mark, and then the number ofcancer cells in the mark is counted.

Processing Sequence in Information Processing System According to theFourth Embodiment

FIG. 14 is a figure showing a processing sequence in the informationprocessing system according to the fourth embodiment. In a sequenceS301, a color scanner 221 reads a HE-stained slide with a mark which isa tissue sample image with a mark. In a sequence S303, the read tissuesample image with a mark is then sent from the color scanner 221 to aclient PC 220 and is further sent to a pathological image diagnosissupport apparatus 200. In a sequence S305, the pathological imagediagnosis support apparatus 200 recognizes the mark.

Subsequently, in a sequence S1401 (mark position storing step), thepathological image diagnosis support apparatus 200 stores a position ofthe mark.

On the other hand, in a sequence S1403, the color scanner 221 reads anIHC-stained slide without the mark which is a tissue sample imagewithout the mark. In a sequence S1405, the read tissue sample imagewithout the mark is then sent from the color scanner 221 to the clientPC 220 and is further sent to the pathological image diagnosis supportapparatus 200.

When the pathological image diagnosis support apparatus 200 receives atissue sample image of the same biological tissue stained by anotherstaining method, the sequence is shifted to a sequence S1409. In thesequence S1409, the position of the mark stored in the sequence S1401 isread out. In a sequence S1411, the tissue sample image with the markread from the HE-stained slide with the mark is aligned with the tissuesample image without the mark read from the IHC-stained slide without amark. FIG. 15 schematically shows the alignment. In FIG. 15, the numeral1500 indicates a HE-stained tissue sample image, the numeral 1521indicates an IHC-stained ER tissue sample image, the numeral 1522indicates an IHC-stained PgR tissue sample image, and the numeral 1523indicates an IHC-stained HER2 tissue sample image. The numeral 1510indicates a HE-stained tissue sample image, and the numeral 1511indicates a mark in the tissue sample image with the mark. The numeral1530 indicates an IHC-stained tissue sample image. The alignment isperformed by pattern matching such as rotating an image, for example.The alignment is described in detail in the patent document 1 and thelike and can be performed appropriately by those skilled in the art.

When the number of cancer cells in each selected area is counted in asequence S1413, the mark 1511 put on the HE-stained tissue sample image1510 can also serve as a mark 1531 of the IHC-stained tissue sampleimage 1530.

In a sequence S1415, the counted number of cancer cells is sent to theclient PC220. At that time, display data of the selected area is sent inaddition to the counted number of cancer cells.

Other Embodiments

The embodiments of the present invention are described in detail above.The scope of the present invention encompasses any system and apparatusobtained by combining characteristics of the embodiments.

The present invention may be applied to a system composed of a pluralityof units or a single unit. The present invention is applicable also inthe case where the control program for achieving the functions of theembodiments is supplied from a system or apparatus directly or remotely.Therefore, the scope of the present invention encompasses a controlprogram installed in a computer so as to achieve functions of thepresent invention, a medium storing the control program, and a WWWserver from which the control program is downloaded.

While the invention has been particulary shown and described withreference to exemplary embodiments thereof, the invention is not limitedto these embodiments. It will be understood by those of ordinary skillin the art that various changes in form and details may be made thereinwithout departing from the spirit and scope of the present invention asdefined by the claims.

This application is based upon and claims the benefit of priority fromJapanese patent application No. 2010-223050, filed on Sep. 30, 2010, thedisclosure of which is incorporated herein in its entirety by reference.

EXPLANATION OF REFERENCE NUMERALS

-   100 information processing apparatus-   110 acquisition section (acquisition unit)-   120 counting section (counting unit)-   150 tissue sample image-   151 mark-   152 selected area (focus area)-   155 image data-   200 pathological image diagnosis support apparatus (information    processing apparatus)-   201 communication control section (receiving unit, sending unit)-   202 image storage section (acquisition unit)-   203 mark recognition section (mark recognition unit)-   204 mark position storage section (mark position storage unit)-   205 mark-specified region selection section (selection unit)-   206 specified region dividing section (dividing unit)-   207 cancer cell counter (counting unit)-   208 display data generation section (display data generation unit)-   220 client PC (input terminal, display terminal)-   221 color scanner (input terminal)-   230 pathological image diagnosis center (display terminal)-   240 network-   250 information processing system-   410 CPU-   420 ROM-   430 RAM-   431 image data to be processed-   432 display data-   433 program execution region-   440 storage-   441 diagnosis support information-   442 various parameters-   443 various programs-   451 tissue sample image with mark received via communication control    section 201-   452 mark image recognized from tissue sample image with mark-   453 image of one selected area selected from received tissue sample    image-   461 selected area-mapped image obtained by mapping selected area    into received tissue sample image-   462 the first selected area image of the first selected area-   463 the first cell count value which is the counted number of cancer    cells with each staining intensity in the first selected area image-   471 received tissue sample image-   472 position and size of selected area as partial region selected    from tissue sample image-   473 the count value relating to cancer cells in selected area-   474 processed display data stored so as to be searchable by tissue    sample image, patient, case, and the like-   481 closed curve extraction parameter for extracting put mark or    added mark on tissue sample image-   482 closed curve formation parameter for distinguishing and    complementing-   483 mesh size parameter-   491 diagnosis support program for supporting diagnosis-   492 mark extraction program for extracting mark on tissue sample    image and recognizing selected area (for executing 5520 of FIG. 5)-   493 cell count program for counting the number of cells with each    staining intensity in image of selected area (for executing 5540 of    FIG. 5)-   494 mesh division program for dividing selected area into meshes-   600 tissue sample image with mark-   601 mark which is closed curve enclosing region 602-   602 region (selected area) in which user desires to count the number    of cancer cells-   700 tissue sample image with marks-   701 rectangular mark-   702 to 704 marks which are closed curves-   800 selected area-mapped image-   801 closed curve extracted from mark-   802 selected area-   900 tissue sample image of selected area-   901 the counted number with each staining intensity-   1000 display screen-   1001 enlarged tissue sample image of one selected area-   1002 reduced-size image of selected area-   1003 thumbnail image of tissue sample image-   1004 thumbnail images of five selected areas, each including    bar-graph-   1010 bar-graph according to selected area-   1011 region indicating the number of cells with “strong” staining    intensity-   1012 region indicating the number of cells with “weak” staining    intensity-   1013 region indicating the number of cells with “none” of staining    intensity-   1100 display image-   1101 tissue sample image-   1102 reduced-size image of selected area-   1103 thumbnail image of tissue sample image-   1104 thumbnail images of five selected areas, each including    bar-graph-   1105 marks of selected areas in each of which the number of cells    has been counted-   1106 marks of added selected areas-   1300 display image-   1301 mark enclosing selected area-   1302 mesh regions in divided selected area-   1500 HE-stained tissue sample image-   1510 HE-stained tissue sample image-   1511 mark of tissue sample image with mark-   1521 IHC-stained ER tissue sample image-   1522 IHC-stained PgR tissue sample image-   1523 IHC-stained HER2 tissue sample image-   1530 IHC-stained tissue sample image-   1531 mark of tissue sample image 1530

1. An information processing apparatus comprising: an acquisition unitfor acquiring image data obtained by reading a tissue sample imageobtained by putting a mark specifying a selected area on an imageobtained by immunostaining and then imaging a biological tissue; and acounting unit for counting the number of cancer cells in the selectedarea specified by the mark based on the image data of the tissue sampleimage acquired by the acquisition unit, wherein a diagnosis based on thetissue sample image is supported.
 2. The information processingapparatus according to claim 1, wherein the selected area is a focusarea of stained positive cells, and the mark is for separating the focusarea from the other area.
 3. The information processing apparatusaccording to claim 2, wherein the mark is a closed curve drawn by a userso as to enclose the focus area.
 4. The information processing apparatusaccording to claim 1, wherein the image data is obtained by reading thetissue sample image from a slide with the mark put thereon.
 5. Theinformation processing apparatus according to claim 1, wherein imagedata obtained by further superimposing a mark specifying a selected areaon the tissue sample image is acquired by the acquisition unit.
 6. Theinformation processing apparatus according to claim 1, wherein the imagedata of the tissue sample image includes a plurality of marks.
 7. Theinformation processing apparatus according to claim 1, wherein thenumber of the stained positive cells with each staining intensity in theselected area specified by the mark in the tissue sample image acquiredby the acquisition unit is counted by the counting unit.
 8. Theinformation processing apparatus according to claim 1, wherein thecounting unit comprises: a dividing unit for dividing the focus area ofthe stained positive cells indicated by the mark into a plurality ofsmall areas; and a small area selection unit for selecting a small areafrom the plurality of small areas, and the number of cells with eachstaining intensity, contained in a small area selected by the small areaselection unit is counted.
 9. The information processing apparatusaccording to claim 8, wherein the counting unit further comprises: adisplay unit for displaying the plurality of small areas into which thefocus area of the stained positive cells is divided by the dividingunit; and an accepting unit for accepting a selection instruction ofselecting a small area contained in the plurality of small areasdisplayed by the display unit from a user, and the number of cells witheach staining intensity, contained in the small area specified by theselection instruction is counted.
 10. The information processingapparatus according to claim 1, further comprising: a mark positionstorage unit for storing a position of the mark in the tissue sampleimage, wherein the selected area specified by the mark is applied toanother tissue sample image obtained by staining the biological tissueby another method and then imaging.
 11. The information processingapparatus according to claim 1, further comprising: a reading unit forreading the tissue sample image; and a display unit for displaying, in adiagnosable format, the number of cancer cells counted in the selectedarea specified by the mark by the counting unit.
 12. The informationprocessing apparatus according to claim 1, further comprising: areceiving unit for receiving, via a network, the tissue sample imagewith a mark specifying the selected area put thereon or the image dataobtained by reading the tissue sample image; and a sending unit forsending, via a network, a count value obtained by counting the number ofcancer cells with each staining intensity in the selected area specifiedby the mark of the tissue sample image received by the receiving unit.13. An information processing system comprising: the informationprocessing apparatus according to claim 12; an input terminal; and adisplay terminal, wherein the image data received by the receiving unitis input and sent via a network by the input terminal, and the number ofcancer cells counted in the selected area specified by the mark by thecounting unit is received via a network and displayed by the displayterminal.
 14. An information processing method using the informationprocessing apparatus according to claim 1, the method comprising: anacquiring step of acquiring, by the acquisition unit, image dataobtained by reading a tissue sample image with a mark specifying aselected area; and a counting step of counting, by the counting unit,the number of cancer cells in the selected area specified by the markbased on the image data of the tissue sample image acquired by theacquiring step.
 15. An information processing method using theinformation processing apparatus according to claim 10, the methodcomprising: an acquiring step of acquiring, by the acquisition unit,image data obtained by reading a tissue sample image with a markspecifying a selected area, a counting step of counting, by the countingunit, the number of cancer cells in the selected area specified by themark based on the image data of the tissue sample image acquired by theacquiring step, a mark position storing step of storing a position ofthe mark in the tissue sample image by the mark position storage unit,and the selected area specified by the mark is applied to another tissuesample image obtained by staining the biological tissue by anothermethod and then imaging.
 16. An information processing method using theinformation processing apparatus according to claim 11, the methodcomprising: an acquiring step of acquiring, by the acquisition unit,image data obtained by reading a tissue sample image with a markspecifying a selected area, a counting step of counting, by the countingunit, the number of cancer cells in the selected area specified by themark based on the image data of the tissue sample image acquired by theacquiring step, a reading step of reading the tissue sample image by thereading unit; and a displaying step of displaying, in a diagnosableformat by the display unit, the number of cancer cells counted in theselected area specified by the mark by the counting unit.
 17. Aninformation processing method using the information processing apparatusaccording to claim 12, the method comprising: an acquiring step ofacquiring, by the acquisition unit, image data obtained by reading atissue sample image with a mark specifying a selected area, a countingstep of counting, by the counting unit, the number of cancer cells inthe selected area specified by the mark based on the image data of thetissue sample image acquired by the acquiring step, a receiving step forreceiving the tissue sample image or the image data by the receivingunit via a network; and a sending step of sending the count value by thesending unit via a network.
 18. An information processing method usingthe information processing apparatus according to claim 13, the methodcomprising: an acquiring step of acquiring, by the acquisition unit,image data obtained by reading a tissue sample image with a markspecifying a selected area, a counting step of counting, by the countingunit, the number of cancer cells in the selected area specified by themark based on the image data of the tissue sample image acquired by theacquiring step, a receiving step for receiving the tissue sample imageor the image data by the receiving unit via a network, a sending step ofsending the count value by the sending unit via a network, an inputtingand sending step of, by the input terminal, inputting and sending, via anetwork, the image data received by the receiving unit; and a receivingand displaying step of, by the display terminal, receiving via a networkand displaying the number of cancer cells counted in the selected areaspecified by the mark by the counting unit.
 19. A program capable ofexecuting the information processing method according to claim 14 on acomputer.
 20. A computer-readable recording medium comprising: theprogram according to claim 19.